Papers with semantic meaning
LingConv: An Interactive Toolkit for Controlled Paraphrase Generation with Linguistic Attribute Control (2025.emnlp-demos)
Copied to clipboard
| Challenge: | LINGCONV is an interactive toolkit for controllable text generation . it allows fine-grained control over 40 specific linguistic attributes spanning lexical, syntactic, and discourse dimensions. |
| Approach: | They propose a toolkit for paraphrase generation that allows finegrained control over 40 specific linguistic attributes. |
| Outcome: | The toolkit is available at https://mohdelgaar-lingconv.hf.space, with a demo video at https:youtu.be/wRBJEJ6EALQ. |
MZET: Memory Augmented Zero-Shot Fine-grained Named Entity Typing (2020.coling-main)
Copied to clipboard
| Challenge: | Named entity typing (NET) is a classification task of assigning an entity mention in the context with given semantic types. |
| Approach: | They propose a memory-augmented FNET model to tackle unseen types in a zero-shot manner. |
| Outcome: | The proposed model outperforms the state-of-the-art models with up to 8% gain in Micro-F1 and Macro-F1. |
Semi-supervised Adversarial Text Generation based on Seq2Seq models (2022.emnlp-industry)
Copied to clipboard
| Challenge: | In contrast, adversarial training has been used in computer vision to improve models’ robustness due to the discrete nature of text. |
| Approach: | They propose a way to generate adversarial samples by using pseudo-labeled in-domain text data to train a seq2seq model for adversarials and combine it with paraphrase detection. |
| Outcome: | The proposed model generates realistic and relevant adversarial samples compared to other state-of-the-art models and recovers up to 70% of errors. |
An Information-Theoretic Approach to Analyze NLP Classification Tasks (2024.acl-long)
Copied to clipboard
| Challenge: | Natural language processing (NLP) tasks take either a single or multiple text elements to predict an output variable. |
| Approach: | They propose an information-theoretic framework to analyse the influence of inputs on the output of text classification tasks. |
| Outcome: | The proposed framework is available at: https://github.com/WangLuran/nlp-element-influence. |
PANCETTA: Phoneme Aware Neural Completion to Elicit Tongue Twisters Automatically (2023.eacl-main)
Copied to clipboard
| Challenge: | Phonetic difficulty is hard to characterize and can be expressed in tongue twisters through alliteration and homophony. |
| Approach: | They propose a phoneme-aware neural completion to generate tongue twisters automatically . they leverage phoneme representations to capture phonetic difficulty and train language models . |
| Outcome: | The proposed language model generates novel, phonetically difficult, fluent, and semantically meaningful tongue twisters on two task settings. |
Parameter-free Sentence Embedding via Orthogonal Basis (D19-1)
Copied to clipboard
| Challenge: | Existing methods to build sentence embeddings are parameterized and require training to optimize their parameters. |
| Approach: | They propose a non-parameterized method to combine pre-trained word embeddings into sentence representations using an orthogonal basis of the word vector subspace and its surrounding context. |
| Outcome: | The proposed method shows superior performance on 11 downstream NLP tasks and is competitive to other methods relying on large amounts of labelled data or prolonged training time. |
Form and Meaning in Intrinsic Multilingual Evaluations (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing metrics for conditional language models are not universally comparable . a number of assumptions are made about their quality in multilingual settings . |
| Approach: | They make assumptions about the quality of conditional language models and their semantic meanings that are not consistent with current metrics. |
| Outcome: | The results show that current evaluation metrics are not universally comparable . they use six metrics on two multi-parallel corpora with mono- and multilingual models . |
The Feasibility of Embedding Based Automatic Evaluation for Single Document Summarization (D19-1)
Copied to clipboard
| Challenge: | Existing evaluation methods for summarization systems measure semantic overlap between a system summary and a human reference on word-string level. |
| Approach: | They propose to use distributed representations to evaluate system summary and human reference on word-string level. |
| Outcome: | The proposed representations outperform ROUGE on recent corpora but are less good on test data used in previous studies. |
A Reference-free Segmentation Quality Index (SegReFree) (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Topic segmentation is the process of finding boundaries in sentences that separate groups of adjacent sentences at shifts in semantic meaning. |
| Approach: | They propose a reference-free segmentation quality index to assess segmentation . metric uses a modified cluster validity metric with semantic embeddings of the sentences . |
| Outcome: | The proposed metric uses a modified cluster validity metric with semantic embeddings of the sentences to determine the quality of the segmentation. |
Audio-centric Video Understanding Benchmark without Text Shortcut (2025.emnlp-main)
Copied to clipboard
Yudong Yang, Jimin Zhuang, Guangzhi Sun, Changli Tang, Yixuan Li, Peihan Li, Yifan Jiang, Wei Li, Zejun Ma, Chao Zhang
| Challenge: | Recent advances in multimodal large language models (MLLMs) focus on visual abilities, but audio is essential for video understanding. |
| Approach: | They propose an audio-centric video understanding benchmark to evaluate video comprehension capabilities of multimodal LLMs with a particular focus on auditory information. |
| Outcome: | The proposed video understanding benchmarks evaluate video comprehension capabilities of multimodal models with a particular focus on auditory information. |
Not All Metrics Are Guilty: Improving NLG Evaluation by Diversifying References (2024.naacl-long)
Copied to clipboard
Tianyi Tang, Hongyuan Lu, Yuchen Jiang, Haoyang Huang, Dongdong Zhang, Xin Zhao, Tom Kocmi, Furu Wei
| Challenge: | Existing evaluation benchmarks with limited references may not accurately reflect the quality of the model’s hypotheses. |
| Approach: | They propose a method to enrich evaluation benchmarks by diversifying the expression of a single reference into multiple high-quality ones to cover the semantic space of the reference sentence as much as possible. |
| Outcome: | The proposed method can enhance evaluation benchmarks by diversifying the expression of reference into multiple high-quality ones to cover the semantic space of the reference sentence as much as possible. |
REFFLY: Melody-Constrained Lyrics Editing Model (2025.naacl-long)
Copied to clipboard
| Challenge: | Automatic melody-to-lyric (M2L) generation aims to create lyrics that align with a given melody. |
| Approach: | They propose a framework for automatic melody-to-lyric generation that allows for a more flexible approach to creating lyrics from plain text. |
| Outcome: | The proposed framework outperforms baselines Lyra and GPT-4 in musicality and text quality. |
Unmasking the Imposters: How Censorship and Domain Adaptation Affect the Detection of Machine-Generated Tweets (2025.coling-main)
Copied to clipboard
| Challenge: | generative AI has been used to generate fluent and convincing text on social media platforms . a new study examines the generative capabilities of four popular large language models . |
| Approach: | They propose a methodology to examine the generative capabilities of four prominent LLMs on Twitter using a dataset from Llama 3, Mistral, Qwen2 and GPT4o. |
| Outcome: | The proposed method examines the generative capabilities of four prominent LLMs on Twitter. |
Enhancing Explainable Rating Prediction through Annotated Macro Concepts (2024.acl-long)
Copied to clipboard
| Challenge: | Existing models learn user and item embeddings and generate reasons based on these embedds. |
| Approach: | They propose a concept-based explanation framework that leverages macro concepts to bridge the gap between the user/item embeddings and the recommendation reasons. |
| Outcome: | Extensive experiments on three datasets prove the proposed model is superior to existing models. |